SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



SCHOOL- 

SYSTEM 



\G0 



SYSTEM 



H&TM0RK 



120 



A. 



130 



1 




STOPS NT 
SYSTEM 




STUDENT 
N 










• * * 


i 








m- 7 






.j 





PRocess»w<5- 




10- 



no- 



100 



Fie-, l 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



210-^ 



Spatial-Temporal 
Education Module 



STAR Math Video Games 



scores 



Diagnostic Quizzes 



-scores 



2.H0 



Math integration Lessons 



ISO 



Advanced Math Concept Tests scores 



v V 



Analysis & Feedback 
Processing System 



Math Reader 



L )50 



Recommendations 



210 



Music Instruction 



200 

fl6 . Z 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBA CK OF 
STUDENT PERFORMANCE 
Bodner, et al 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



Toys 





cA: 











Toys 



Puzzles Bricks Spaceship 



I , 




To tit* Candy 

Ice Cave* store fish Hunt TitwkMeet 




Helicopter 





AttheCotmfy 
Sw the Fish! Store 






Tag -«-Boat Save the Storffeh iUlSays 




ozone 




Dig Seed JiJiMcift 



f\&- 3 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



» r ! 
I 




Bricks Review Ice Coves Review 



Picture Day 

Retakes ice Blocks Tugboat Review Starfish Review StarWatchina: 2 Probably.. 





MathFactoty Shopefcwtory PleMonster FrecWaU2 J|fs Adventure StarWatchlng 



♦ 



Gopher Gormen 




cattle 



Big Seed 




f\G. H 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 




Fl<r. 5 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

AppLNo.: Unknown Atty Docket: PB-MIND.002A 



STAR Proportions 




Spaceship must intercept the amount of 
round "fuel pods" to fill the green 11 fuel 
tank" based on the example at the top of the 
screen, with 2 fuel pods filling the square tank. 



B 



AMC Proportions 

1 

m 





— it 



S3. 



Students choose spoons of sugar in the 
correct proportion to make sugar water 
based on the example 



<oOZO 



Math Integration 



Nanie__ 



Diagnostic Quiz 



6o3o. 



Make this a true number sentence. 



Not 




< 








> 


Here 















1. Draw lines to make the shapes below into triangles that are 
ute same size as the key. 

2. Write how many triangles for each shape below it 

3. How many fuel pods (£)? Now use the key to write how 
many fuel pods (£) you need for the shapes. 



KEY 



Number of itttngles: 
Number of ftwl pods; 




(=CHO 



I. Use the key to decide how many fuel pods (#) you need 
for the shapes below. 



KEY 

□ 



fofftjd podi: 





ftoffUel pods: 



D 



720 {OFF^iiTZ 



124 f 

4 



OFFICIALS 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl. No.: Unknown Atty Docket: PB-MIND.002A 



730 



AJo/y-sctfooL 
©FFK/ALs 

- I z 





PARENT 







no 



ScMooL- J 
OFFICIAL -"^ 



INSTRUCTOR 
(TeACHeiQ, 




760 



£°UCATlDti 

module 



FeevBAcK data 


Analysis & 

STSTtFJV\ 


y PzHFomAHCZ &ATA 




^ 7H0 



S 
700 

FI6. 7 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl. No.: Unknown Atty Docket: PB-MIND.002A 



7K 



QE/JeliPtTidM 
PRoces$iAi<z- 




ISO 



NETWORK 



FI6-. 2 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



MultUistener 



720 



mdata, qdata, AMC analysis 



Real-Time 
Graphing of 
Learning Curves 



Individual Student 
Learning Curve in 
Realtime 



q-3o 



Datastorage 



Real-time Algorithmic 
Analysis of learning curve 



<?70 



Data analy sis 
D.D.B. 




Comparison analysis 
of STARaiid Quiz data 



Real-lime scoring and 
analysts of diagnostic quiz 



Feedback Recommendations 



Feedback Recommendations 



Advanced Math Concepts test 
scoring and analysis 

1 cJ%w 



Analysis and Feedback 



g30 



F16-. <? 



\o\o- 



\ooo 




mm 

mum 

nmnmm 



to 



1 | 1 1 I Wff i ft 



! 




1050 



WiidowD 



-. L , J r ! ,l l J : i J. ' j":, 1 ." J.. ■ ■ ' ■ t 'vfTAL^ ' l'H ' UlM W ■ . WM ■ ,1, 1 „.,1 HM W 













P3bf3:ASGtWd): ; ; 






'; "V 















SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



mo 



TttcltifA 
TmsbhB 
ImdmC 



Tttforl 



MirM 



TttSiwQ 
Tsacteft 



Mi/ 
TttShiiX 



1100 







[Scfioo 








Hi 












I STAR *BP«s 



05 
04 
« 

53 
10 
11 
12 
1713 




01 



14 
15 
16 



101? 
10 18 



20 



SfudentA 



Student E 



MuMK 
SludMll 



U20 




1130 



FI&. 11 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK Ob 
STUDENT PERFORMANCE 
Bodner, et al 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



Bodner, ei al. 
No.: Unknown Atty Docket: PB-MIND.002A 




mi: 

JW2: .!AM1imiJB(M11flm i WWt5m.1ft1fli«|1MCMie 

s 



mi .1/10 oa 11 mm m 11 mm o& \m\mm 



mi mmmm%mwmwm 



400,10,100^ 



o; 



>■ ^ : : Ifc :! - r 



...» ,,.<,.. „. . . 



\HOo 



FI6. If 



? SchootA 



SchooiE 

ScfwIG 
ScttMlH 



OTP J 



SetodlN 
SchoolO 



Stfwoifi 
stums 

ScfwUT 
SehoolU 



SWAB 



Wo 



1 

9 S 



5 



I 

CO 



as 

.1 

1 

I 

5 



I 



RESPONSE RECSVED 



; vi:',;!:.-;!.?;!;!. 



10 W,M, Bricks 

11 C.L 
M JA 

13 LA CsinlyStofe 

14 J,F. 

15 J.E, 

10 H.C, BrlcK8 



1572 




Move On 
Contra 
Continue Play 



ISZO 



1500 



FIG. 15 




16 8(1 2 I 18 9 good jot) 

17 CL 2 10 10 10 0$ Mm^^ 



1400 FI6-. « 



I 
u 

S3. 



to 



i 

1 

3 



■§ 

I 

J 
5 



§: 




•; \: . ■ .. 4 rv^yrjy^ <■ ■■:: titf^frz. ii ■ v;.> j¥» r^!,r: ...... : i. 

• : ^ ^irSil^^i f- b& P<-; :• : •: •^••v 



(goo 




I Too 



2010 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



2.020 




MA 



StwfcitE 
9W*itF 

8MMtN 



Student J 
8M(MtK 

StudWM 

mm? 
mm 



StuKntW 
StrtdMiX 



^ ( / ; * ^ } ^^^^^^^^ 



1 



I'rlr'-lfii'iiiiln"- i 



"blank scores elminaled" 



number of trisb^naximiin scored f of 1st pass^core,Uial fi of second pais,score,tn'«I i of third pass^oore 

24,350,13,340,16,330,21,350 

28,370,14,345,15,330,16,350 

29,335,27,335 

24,260 

34,380,18,370,19,330,20,345 
3,380,3,380 

16,380,4,325,7,355,8,355 

25,370,7,330,16,340,17,330 

33,320 

2,360,2,360,,,, 

29,400,8,365,11,330,12,370 

3,155 

3,160 

27,365,20,335,21,355,22,345 
23,325,23,325 

26,340,17,340 

22,330,12,330,16,325,20,330 
34,350,31,350 
27,400,7,325,8,365,9,330 
32,390,6,330,8,355,9,325 
30,385,16,325,18,365,19,375 
27.350.20.340i2.325.24.350 



m 



7.030 



Si 



";f> <.-v 




looo 



fit. 20 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

AppLNo.: Unknown Atty Docket: PB-MIND.002A 



zzio 



400 



150 

too 



0 li ii 11 1 



1 10 20 30 40 

Number of Plays 



D 



J \ I 



5 10 15 

Number of Hays 



20 



B 




50 100 

Number of Plays 



E 



2S0 
£00 

isp 

100 

»o 

0 




S 10 n to ts M IS 40 

Number of Plays 



CO 



1«C 
140 
10O 



40 

20 



"2.2.30 




1 10 20 

Number of Plays 




2.100 



F 16-. 2.2 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et ah 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 




Number of Plays 



Z3oo 



Fl£. 23 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



7H\0 



, D eiOTkFtcAT/OA> 

DATA 



SEhiD SC0\Z£S 
fb ANALYSIS 



± 



ZM30 



ZHMO 



U 



C- ■ — ' — x *i 



2.W 



FI6-. 2^ 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl. No.: Unknown Atty Docket: PB-MIND.002A 



P#TA 


ve Scone 


> 


f 


GReATe Pathway 

AMD AhJALiSiS 






LE"ARN 

j -r- 





2520 



2.S30 



Z5^0 



^ 

1 T-SSO 



r ^ v25-<?0 



2£"0O 



FI6-. a£ 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBA CK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl No.: Unknown Atty Docket: PB-MIND. 002 A 



24,10 



\ 


/ 









J 



2 430 



I 



2640 
U 



2650 



Feek?8dcK 



2460 



ZMD 



FIG. 26 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, el al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



F&rttwt on vmsdl db*dtatt» 



CWVP 



- «kn»iifi^«» evnv ibmai 

& Step* dfetwraradfimnifam^ 



No 



valtia (Knot pvabraxKiflki lovwls 



Kb 



Dti^a Midi Inftgmtifia 



adwewmej* level* 



T 



Kb 



7S«3 



wpw|«rfal»rawx» rtatictksd noaxsi for. 



Game Injetnporated into Education Module • 



Fl 6-. 27 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al. 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



Identify mathematical concept 



Formulate basic spatial temporal 
test on mathematical concept 



282^ 



Design game using spatial temporal approach 
to teach / illustrate mathematical concept 



Administer basic spatial temporal test 



ZZ30 



Pilot test game on small sample of students 
to obtain progress curve of game scores 



-yes- 



Analyze progress curve: Does it indicate successful 
learning and retention of mathematical concept? 



-no-* 



Redesign 
game 



Compare game scores with performance 
on basic spatial temporal test: Do game 
scores correspond to test performance? 



no 



— yes-> 



Design math integration components: 
1 . Diagnostic quiz 
2. Math integration lesson 



Adjust game scoring parameters and/or 
complexity of basic spatial temporal test 



Administer diagnostic quiz * 



r 2m 



Compare game scores with performance 
on diagnostic quiz: Do game scores 
correspond to diagnostic quiz performance? 



yes 



Adjust game and/or math 
integration components 



2274 



Test game and quiz on 
larger sample of students 



Integrate into curriculum 



fig. a? 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 



Has student attained 
passing score in game? 



-no- 



Days of game play > ^ 
allotted number of days? r~ no "*i 




# of game plays > MAX1 with 
no significant improvement? 



I 

no 



2.1 3 H 



# of game plays / day < MINI 



Graph score vs. # of game plays 
for most recent day 



Graph score vs. # of game plays 
for all days 



\7 



Statistical analysis: are there polnt(s) of 
significant deviations in learning rate? 



-yes> 



Flag for teacher's attention 



no 



Calculate best fit curve 



Extrapolate curve until 
# of game plays = MAX2 



Does extrapolated curve based on 
scores from most recent day reach 
passing score? 



Does extrapolated curve based on 
scores from all days reach passing 
score? 



2T7?C 



-both do- 



Continue 
play 



-neither does- 



C 



one does and the other does not 



Continue play with 
observation & revaluation 



Needs 
assistance 



"2$ n 



F I <r. 2<f 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et ai 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



Total quiz questions answered >= MIN? 



Quiz total score >= 
passing score? 

! 

yes 



-yes- 



no 



no J 

gg9 



Unanswered questions 
mostly from end of quiz? 



Lno- 



yes 



(Review test ^ 
taking skills / 



r 3Q20 



^30 3? 



Move onto next 
math concept 



yes 



All quiz subsection scores >= LIMIT? 



£ 



-no- 



-yes- 



I r3QH0 



Quiz total score >= 
passing score? 



For each subsection score < LIMIT find 
corresponding STAR math video game(s) 



no 



r 3Q£>Q 



Needs assistance 
and practice 




Check score for each STAR 
math video game from above 



-failing-*^ 



Review STAR math video game 
with instructor assistance 



passing 



Common math key word(s) or phrase(s) 
among incorrectly answered quiz questions? 



-no- 



Retake 
quiz 



Review math 
integration lesson 



yes 



(Review math 
reader J 




300O 



FIG. 3 0 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

ApplNo.: Unknown Atty Docket: PB-MIND.002A 



Total test questions answered >= MIN? 



Test total score >= 
passing score? 



yes 



-yes- 



no 



r— no J 

r>3/if 



Unanswered questions 
mostly from end of test? 



l~no 



yes 



C Review test \ 
taking skills J 



1 ^3/30 u 



Move onto next 
math concept 
3f~ 



All test subsection scores >= LIMIT? 



i 



-no- 
3 ISO 



-yes- 



yes 

I r-?/34 



Test total score >= 
passing score? 



For each subsection score < LIMIT find 
corresponding STAR math video game(s) 






> ^3\SH 




Check score for each STAR 
math video game from above 


—failing 



no 



Needs assistance 
and practice 



Review STAR math video game y 
with instructor assistance J 



Retake 
quiz 



passing 

+ r 3 \hO 



(Review math y 
reader J 



/ 

3I0O 



31 



SYSTEM AND METHOD FOR ANALYSIS AND FEEDBACK OF 
STUDENT PERFORMANCE 
Bodner, et al 

Appl.No.: Unknown Atty Docket: PB-MIND.002A 




32.00 

FIG-. 32 



Start 



-33/0 



Receive 
Scoizes or 




33ZO 
U 



3330 



I 



I 



1 

0 



^3 Ss"^ 



9 £ ^ 

03 



Cg Co 



.5 

5 




Yes 



<>TUI&tSC 
Moves ok) 



S3SH 

V 



APPLY 


U , 

Seeming 
ITHH1D 

Mm 






1 ^ 

of 6e$r 


f - ' — 1 

Sim 

Fit 

> 



3350 



3340 



337H 




337o 



33$0 



3300 
fig. 33 



